Conversational transfer learning for emotion recognition
نویسندگان
چکیده
Recognizing emotions in conversations is a challenging task due to the presence of contextual dependencies governed by self- and inter-personal influences. Recent approaches have focused on modeling these primarily via supervised learning. However, purely strategies demand large amounts annotated data, which lacking most available corpora this task. To tackle challenge, we look at transfer learning as viable alternative. Given amount conversational investigate whether generative models can be leveraged affective knowledge for detecting context. We propose an approach, TL-ERC, where pre-train hierarchical dialogue model multi-turn (source) then its parameters emotion classifier (target). In addition popular practice using pre-trained sentence encoders, our approach also incorporates recurrent that inter-sentential context across whole conversation. Based idea, perform several experiments multiple datasets find improvement performance robustness against limited training data. TL-ERC achieves better validation performances significantly fewer epochs. Overall, infer acquired from generators indeed help recognize conversations.
منابع مشابه
Feature Transfer Learning for Speech Emotion Recognition
Speech Emotion Recognition (SER) has achieved some substantial progress in the past few decades since the dawn of emotion and speech research. In many aspects, various research efforts have been made in an attempt to achieve human-like emotion recognition performance in real-life settings. However, with the availability of speech data obtained from different devices and varied acquisition condi...
متن کاملProgressive Neural Networks for Transfer Learning in Emotion Recognition
Many paralinguistic tasks are closely related and thus representations learned in one domain can be leveraged for another. In this paper, we investigate how knowledge can be transferred between three paralinguistic tasks: speaker, emotion, and gender recognition. Further, we extend this problem to cross-dataset tasks, asking how knowledge captured in one emotion dataset can be transferred to an...
متن کاملEmotion recognition of conversational affective speech using temporal course modeling
In a natural conversation, a complete emotional expression is typically composed of a complex temporal course representing temporal phases of onset, apex, and offset. In this study, subemotional states are defined to model the temporal course of an emotional expression in natural conversation. Hidden Markov Models (HMMs) are adopted to characterize the subemotional states; each represents one t...
متن کاملRecognition and Analysis of Emotion in Indonesian Conversational Speech
The importance of incorporating emotional aspect in human computer interaction continues to arise. Unfortunately, exploration of the subject in Indonesian is still very lacking. This paper presents the first study of emotion recognition in Indonesian on conversational speech. We construct our corpus, IDESC, by making use of television talk show recordings in various topics of discussion, yieldi...
متن کاملActive learning for dimensional speech emotion recognition
State-of-the-art dimensional speech emotion recognition systems are trained using continuously labelled instances. The data labelling process is labour intensive and time-consuming. In this paper, we propose to apply active learning to reduce according efforts: The unlabelled instances are evaluated automatically, and only the most informative ones are intelligently picked by an informativeness...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information Fusion
سال: 2021
ISSN: ['1566-2535', '1872-6305']
DOI: https://doi.org/10.1016/j.inffus.2020.06.005